Problem Note 55687: The SAS® Environment Manager master ACM ETL process fails and returns the error "The ID value 'XXXXXX' occurs twice in the same BY group"
The SAS Environment Manager master Agent-Collected Metric (ACM) extract, transform, and load (ETL) process might fail. The resulting SAS® log file is located in the emi-framework/Logs directory. The filename has the following syntax: updateEVDM_YYYYMMDD_HHMM.sas.log. The log contains errors or notes that are similar to the following:
ERROR: The ID value "XXXXXX" occurs twice in the same BY group.
ERROR: Too many bad BY groups.
NOTE: *** Macro LOCKDS: Called to LOCK table (ACM.HOSTPLATFORMS)***
This problem occurs when all of the following conditions apply:
- SAS Environment Manager is installed.
- The Service Architecture ACM ETL has been enabled.
- The ACM ETL process is interrupted for more then nine days.
When there is at least a nine-day lapse of collected ACM ETL data, the data-extract step attempts to pull more than nine days' worth of data. The extracted data is stored in a rolling set of tables, which is where an older table is dropped when a new table is read in. In this case, some tables are queried multiple times and the same data is extracted repeatedly. These duplicate records result in the failure of the master ACM ETL process.
To work around this issue, submit the following SORT procedure:
libname evdmraw 'SAS-configuration-directory/Web/SASEnvironmentManager/emi-framework/Datamart/evdmraw';
proc sort data=evdmraw.hq_metric_data nodupkey;
by datetime measurement_id;
run;
This procedure eliminates the duplicate records from the appropriate data set, which enables the ACM ETL process to run successfully.
Click the Hot Fix tab in this note to access the hot fix for this issue.
Operating System and Release Information
SAS System | SAS Environment Manager | Microsoft® Windows® for x64 | 2.4 | 2.5 | 9.4 TS1M2 | 9.4 TS1M3 |
64-bit Enabled AIX | 2.4 | 2.5 | 9.4 TS1M2 | 9.4 TS1M3 |
64-bit Enabled Solaris | 2.4 | 2.5 | 9.4 TS1M2 | 9.4 TS1M3 |
HP-UX IPF | 2.4 | 2.5 | 9.4 TS1M2 | 9.4 TS1M3 |
Linux for x64 | 2.4 | 2.5 | 9.4 TS1M2 | 9.4 TS1M3 |
Solaris for x64 | 2.4 | 2.5 | 9.4 TS1M2 | 9.4 TS1M3 |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
When a virtual image has been offline for more than nine days, the SAS Environment Manage master ACM ETL processes ends in errors.
Type: | Problem Note |
Priority: | medium |
Date Modified: | 2015-06-03 14:15:01 |
Date Created: | 2015-04-29 16:55:08 |